DOCUMENT RESUME 



ED 311 553 



EA 021 324 



AUTHOR 
TITLE 



Valentine, Jerry W. 

The Audit of Principal Effectiveness: A Process for 
Self-Improvement . 
Apr 89 

17p.; Paper presented at the Annual Meeting of the 
North Central Association (Chicago, IL, April 17, 
1989). For related documents, see EA 021 323-325. 
Guides - Non-Classroom Use (055) — 
Speeches/Conference Papers (150) 



PUB DATE 
NOTE 



PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



MF01/PC01 Plus Postage. 

•Administrator Effectiveness; "Administrator 
Evaluation; Elementary Secondary Education; 
■^Evaluation Criteria; "Evaluation Methods; Leadership 
Qualities; National Surveys; "Principals; Teacher 
Administrator Relationship 
*Audit of Principal Effectiveness 



ABSTRACT 



Feedback data provide an avenue to improved 



perceptions; in the educational setting, improved oerceptions 
translate into personal growth and more positive organizational 
culture. To provide a valid, reliable, and practical instrument for 
faculty feedback regarding administrative skill, the Audit of 
Principal Effectiveness was developed in 1982 • Over the next 4 years 
the instrument was statistically anaylzed, used in research and 
schools, refined, reanalyzed, and shortened; since 1986 it has been 
used in numerous research studies and in hundreds of schools across 
the country. The revised instrument provides the principal with 
teacher insight on 80 items of principal effectiveness. In addition, 
teacher perceptions are provided regarding three domains: (1) 
organizational development containing the factors of organizational 
direction, linkage, and procedures; (2) organizational environment 
containing the factors of teacher and student relations, and 
interactive and affective processes; and (3) the educational program 
containing the factors of instructional and curricular improvement. 
Factor scores within the three domains provide the principal with an 
understanding of personal administrative skills beyond the scope of 
each individual instrument item. Suggestions for use of the audit 
include providing anonymity for person:* completing the instrument and 
summarizing and sharing the findings froiu <-he assessment with the 
faculty. (3 references) (KM) 
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THE AUDIT OF PRINCIPAL EFFECTIVENESS: 
A PROCESS FOR SELF-IMPROVEMENT 



Many of us recall the movie "Snow White" and the scene In which the Queen asked, 
"Mirror, mirror on the wall, who is the fairest of them all?" The Queen desired, and expected, a 
self-satisfying, pleasing answer. She was enraged by the response she received. 

Some would say, 'We should not ask questions to which we do not want to know the 
answer!" Such a negative philosophy has no place in education. We can all benefit from a 
better understanding of how others perceive us, Even though we may not like, nor agree with, 
their perceptions, the data are useful. If used appropriately, feedback data provide an avenue to 
improve perceptions. In the educational setting, improved perceptions may translate into 
personal growth and mere positive organizational culture. Such improvements impact on 
overall school effectiveness. 

A national study of fifty effective principals conducted in the early 1980's proiiied 
effective principals as "people persons" In their human relations ana communication skills, 
in their willingness to practice participatory management in decision makir* and in their 
involvement of others in inservice and developmental activities. They valued "discussion 
with knowledgeable persons" for identifying potential Influences on the school and 
specifically cited communication with faculty as a major means of anticipating curriculum 

needs. 1 Clearly, the more effective principals are not only open to the opinions of others, but 

seek those opinions particularly from the teaching staff. 

The Queen's "Mirror-mirror on the wall" should become the principals' "Teacher- 
teacher in the hall." As described by Bailey, "Faculty feedback—the process of gathering 
information from faculty members for the purpose of improving leadership or administrative 
practices— is one of the most valuable sources available to administrators who are engaging in 
improvement practices."^ 

This presentation was prepared to share information about a recently developed 
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Instrument for assessing principal effectiveness and provide some practical suggssUons for 
use of the instrument. I hope the discussion underscores the importance of teacher feedback to 
principals in a systematic process and encourages the use of valid, reliable assessment 
instruments which provide data for professional growth. 

THE AUDIT OF PRINCIPAL EFFECTIVENESS 

With a goal of providing a valid, reliable and practical Instrument for faculty feedback 
about administrative skill, Dr. Mike Bowman and I began the development of the Audit of 
Principal Effectiveness in 1982. From 1982 through 1986, the instrument was developed, 
statistically analyzed, used in research and school systems, refined, reanalyzed, and 
shortened in order to provide a practical instrument for principals. Since 1986 the instrument 
has been used in numerous research studies and hundreds of schools across the country. 

The revised instrument provides the principal with teacher insight on eighty items of 
principal effectiveness. In addition, teacher perceptions about each of three "domains" and 
nine "factors" are provided. The three domains are "Organizational Development," 
"Organizational Environment," and "Educational Program." Listed below are the working 
definitions of the domains and each of the factors for the domains. Scores on there factors 
provide the principal with an understanding of his/her administrative skill beyond the scope 
of each item of the instrument. 

DOMAIN: ORGJl IZATIONAL DEVELOPMENT 

The Domain of Organizational Development provides insight into the ability of the 
principal to work with personnel inside and outside the school setting to establish processes 
and relationships which most effectively promote positive growth and change of the 
organization as a whole. The specific factors for Organizational Development are defined 
below. 

FACTOR: ORGANIZATIONAL DIRECTION 

The principal provides direction for the school through work with faculty to develop 
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goals, establish expectations and promote appropriate change. 
FACTOR: ORGANIZATIONAL LINKAGE 

The principal promotes positive working relationships between the school, the 
community the school serves and other educators and agencies which work with the school. 
FACTOR: ORGANIZATIONAL PROCEDURES 

The principal utilizes effective procedures for problem-solving, decision-making and 
change. 

DOMAIN: ORGANIZATIONAL ENVIRONMENT 

The Domain of Organizational Environment provides insight into the ability of the 
principal to nurture the on-going climate of the school through development of positive 
interpersonal relationships among members of the organization and effective day-by-day 
operational procedures for the school. The specific factors for Organizational Environment 
are defined beiow. 
FACTOR: TEACHER RELATIONS 

The principal develops effective working relationships with staff through appropriate 
communication skills, sensitivity to needs, appropriate support and reinforcement. 
FACTOR: STUDENT RELATIONS 

The principal develops effective working relationships with students through 
appropriate communication skills, encouragement, support and .ngh visibility. 
FACTOR: INTERACTIVE PROCESSES 

The principal organizes tasks and personnel for the effective day-by-day management 
of the school, including providing appropriate information to staff and students, developing 
appropriate rules and procedures and setting the overall tone for discipline in the school. 
FACTOR: AFFECTIVE PROCESSES 

The principal encourages the expression of feelings, opinions, pride and loyalty 
through team management, sensitivity, humor and personal example. 



DOMAIN: EDUCATIONAL PROGRAM 

The Domain of Educational Program provides insight into the ability of the principal 
to serve as the educational leader of the school through active involvement in instructional 
leadership and curriculum development. The specific factors for Educational Program are 
defined below. 

FACTOR: INSTRUCTIONAL IMPROVEMENT 

The principal Impacts positively upon instructional skills through effective clinical 
supervision, knowledge of effective schooling and commitment to quality instruction. 
FACTOR: CURRICULUM IMPROVEMENT 

The principal promotes an articulated, outcome-based curriculum through diagnosis of 
student needs and systematic program review and change. 



PRACTICAL USES OF THE AUDIT 

In managing today's complex school, systematic insight from persons within the 
organization about a principal's skill has become commonplace. Many school districts expect 
or require principals tc formally survey teachers and identify areas of strength and areas for 
improvement. The 80 Item Audit of Pri ncipal Effectiveness is one of the few valid, reliable 
instruments, readily available to principals for that purpose. Scoring can be completed 
manually or by micro-computer at the school site or by computer throug i the developers. 

Following are four suggestions for use of the Audit or any other similar instrument 
used at the building level to obtain teachers' perceptions for the purpose of self-improvement. 

1. Anonymity of persons completing the instrument should be guaranteed. All data 
should be analyzed as group data or entire school or school district data. For 
example, a principal may find it helpful to know how teachers in the science 
program perceive the principal's ability to provide suggestions for improving 
instructional strategies. Or a principal may wish to better understand the early 
childhood teachers 1 perceptions about the ability of the principal to promote the 
development of effective curricular changes in the school. But in no instance should 
the principal be able to identify from the responses the perception of an individual 
teacher. Whether the principal or school district analyzes the responses on site, or 
whether the data are analyzed by the developers, the means by which the data are 
analyzed and reported should preclude the identification of individuals. 

2. Principals find it helpful to use the same assessment instrument each year for 
several years. This provides baseline information useful in assessing change. 
Though spring is the most common time to administer an assessment survey, some 
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principals prefer a fall and spring assessment to note changes during the year. 
Either or both times are appropriate. The most Important consideration Is to 
develop a consistent pattern so data can be reviewed over a period of years. 

3. All findings from the assessment should be summarized and shared with the 
faculty. T?iis openness adds credibility to the importance of Improvement and sets 
a tone for high expectations and Improvement. The principal can have the data 
analyzed by items, factors and domains. A summary of the findings and suggested 
action plans can be shared via memo with faculty, along with an expression of 
thanks for taking the time to complete the Instruments. In this day of 
accountability and outcome-based education, many principal? find it wise and 
advantageous to share the findings with supervisors who have the responsibility for 
evaluating the principal. Objective data are particularly useful as supportive 
evidence for merit or incentive plans. 

4. Many principals utilize a school improvement committee to assist in th^ 
administration, collection and analysis of data from school surveys such as the 
Audit. Pr'ncipalp are encouraged to use teacher committees to assist with the 
collection and analysis of the data and the identification of school goals for the 
upcoming year. 17 



SUMMARY 

A skill assessment instrument completed by teachers is a valuable tool for the 
principal. It Is neither the only tool, nor the most important tool. Just as the family gardener 
needs the spade, the hoe, the rata, the hose, etc., the principal needs tools to gather data about 
personal skills, accomplishment of school goals, parent attitudes, student needs, etc. With the 
advent of accountability through outcome-based measures, the assessment of personal 
administrative skills becomes more essential. Teacher, teacher in the hall, help me be the 
fairest principal of all" may not metaphorically do Justice to "Snow White," but it does convey a 
message to educators. If we are to be effective educational leaders we must assess our skills and 
develop strategies for Improvement. The Audit, or a similar instrument and process, plays an 
important role in effective educational leadership. 



Addendum 

Tables describing scores of "outstanding" and "random" principals shared via overheads and 
handouts and discussed as baselin data for principals desiring to discuss their skills. 
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AUDIT OF PRINCIPAL EFFECTIVENESS 



"OUTSTANDING" VS. RANDOM 
DOMAIN AND FACTOR SCORES 
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AUDIT OF PRINCIPAL EFFECTIVENESS 
"OUTSTANDING- VS. RANDOM 
HIGHEST AND LOWEST SCORING ITEMS 
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"Outstanding" Schools: Identified by U.S. Dapartmant of Education •Recognition Program" 
prior to 1966. 

Random Schools: Identified by random saving of U.S. & *s in 1967-66 stratiflad by 
grads (avals. 



lu 



MUUII Ul PIUIIUPML LI I LMIVEWEJ3 

"OUTSTANDING" VS. RANDOM T-TESTS 





OUTSTD 


RAND DIF PLEV«L 




OUTSTD 


RAND 


DIF 


p 1 EVE 


ORG DEVELOP 


7 6 


T A 

7.2 


.4 


.0001 


STU REL 


7 5 


7 1 


o 


AC04 


ORG DIR 


7.8 


7.3 


.5 


.0001 




72 


72 


n 

.V 


7A09 


1 

■ 


7.7 


7.1 


.6 


AAA^ 

.0001 


42 


7 2 

9 m€. 


70 
/ .U 


o 


104ft 
.1 WO 


9 


7.7 


7.2 


.5 


.0001 


43 


7 9 


ft ft 

v.O 




0A44 


3 


8.4 


7.8 


.6 


.0001 


44 


7.7 


7.3 


.4 


.0011 


4 


7.8 


7.3 


.5 


.0001 


45 


7.6 


7.2 


.4 


.0040 


5 


8 1 


7.4 


.7 


.0001 


46 


7 4 


7 4 


A 
.V 


fiOftl 

.0901 


ft 


7 8 


7.4 


.4 


.0001 


47 


7 7 


7 5 


O 


0^1 ft 


7 

/ 


7 5 


7.0 


.5 


.0001 


48 


7 ft 


7 ft 




147A 


ORG LINK 


7.7 


7.2 


.5 


.0001 


INTER PROC 


7 ft 


74 


4 


0001 


ft 

w 


7.6 


7.0 


.6 


.0001 


49 


79 

f m9 


75 




0007 

.WW/ 


g 


7 6 


a a 

6.8 


.8 


AAA 4 

.0001 


50 


7 ft 




4 


0001 


10 


7.2 


6.5 


.7 


AAA.* 

.0001 


51 


7 8 


74 


4 


0001 


1 1 


75 


6.8 


.7 


.0001 


52 


A 0 
o.u 


75 


c 


0001 


12 


8 3 


8.1 


.2 


.0005 


53 


7ft 


74 




0009 


13 


8 0 


/.9 


.1 


.2321 


54 


7 7 


7 4 






14 


7 8 


7.3 


.5 


.0001 


55 


7 5 


79 


.o 




15 


7 9 


7.3 


.6 


.0001 


58 


7 Q 


7 ft 


o 


000Q 

•VW9 


16 


7 9 

9 *9 


7.5 


.4 


.0001 


57 


7 4 


7 1 




0010 


17 


7 7 


7.1 


.6 


.0001 












18 


7 4 


6.9 


.5 


.0001 


AFF PROC 


7 1 


ft ft 


c 


0001 












58 


7 7 


7 9 


J 


0001 


ORG PROC 


7 3 


7.0 


3 


.0001 


59 


7 4 


7 0 




AAA1 


19 

1 9 


7 2 


6.9 


.3 


.0225 


fin 

w 


7 0 
/ .U 


ft ft 

D.O 


.£ 


0117 


20 


7 3 


6.9 


.4 


.0064 




ft 9 


0.9 


o 

.CI 


01U 
.U 190 


21 


7 2 


7.0 


.2 


.0354 


82 


7 4 


7 0 


4 


0001 


22 


7 5 


7.3 


.2 


A 4 A A 

.1180 


ftfl 


7 4 


7 0 




.UwO 


23 

Ml 


7.7 


7.3 


.4 


.0001 


64 


7 6 


fiQ 


7 


0001 

Uwl 


24 


7.4 


7.1 


.3 


.0028 












25 


7 4 


7.1 


.3 


. .0036 


FHUC PGM 


7 5 


/.I 




0001 

•VWl 


26 


6 8 


6.4 


.4 


.0045 


INST IMP 


7 ft 


7 0 






27 


7 3 


7.0 


.3 


A AAA* 

.0222 


65 


7 ft 


7 5 




000A 












fifi 


7 7 






00A9 

• VVVb 


ORG ENVIRON 


75 


7.2 


3 


.0007 


87 


7 7 


7 1 




0010 


TCHR RFL 


7 5 


7.2 


3 


.0046 


oo 


7 * 


7 0 




01 7ft 


28 


7 2 


6.9 


.3 


.0165 


ftQ 


ft 7 
Q./ 


ft A 


O 

.o 




29 


7 1 


6.8 


.3 


.0265 


70 


7 7 


7 0 


c 


0001 


30 


7 5 


7.1 


.4 


.0019 


71 


7 5 


7 4 

/.I 


A 


0001 


31 


7 0 


6.7 


.3 


.0136 


79 


ft 1 


7 ft 


.o 


0001 


32 


7.4 


an a 

7.2 


.2 


.1611 












33 


78 


7.4 


.4 


.0006 


rnr q imp 


7 5 


70 


c 


0001 


34 


7 5 


7.3 


.2 


.0265 


73 


7 ft 

/ -O 


7 4 


A 


0001 
.Uwl 


35 


7 4 


7.2 


.2 


.0731 


74 


7 ft 


7 O 




0A01 
.UUU1 


36 


7.8 


7.6 


.2 


.0623 


75 


7.6 


7.1 


.5 


.0001 


37 


7.6 


7.3 


.3 


.0572 


76 


7.4 


7.0 


.4 


.0001 


38 


7.6 


7.3 


.3 


.0156 


77 

f . 




ft ft 


o 


0099 


39 


7.6 


7.3 


.3 


.0384 


78 


7.2 


6.7 


.5 


.0001 


40 


8.1 


7.4 


.7 


.0001 


79 


7.6 


7.1 


.5 


.0001 




OVERALL EFFECTIVENESS: 


ITEM 80 


7.8 


7.4 


.4 


.0001 



■OUTSTANDING* SCHOOLS: IDENTIFIED BY U.S. DEPARTMENT OF EDUCATION 'RECOGNITION PROGRAM* PRIOR TO 1988. 
RANDOM SCHOOLS: IDENTIFIED BY UJDOM SAMPLING OF U.S. SCHOOLS IN 1087-88. STRATIFIED BY GRADE LEVELS. 
"VTA COLLECTED 1887-88 



11 



AUDIT OF PRINCIPAL EFFECTIVENESS 
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AUDIT OF PRINCIPAL EFFECTIVENESS 

RANDOM SCHOOLS 
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RANDOM SCHOOLS: IDENTIFIED BY RANDOM SAMPLING OF US. SCHOOLS IN 1987*68 
STRATIFIED BY GRADE LEVELS 
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AUDIT OF PRINCIPAL EFFECTIVENESS 
"00 (STANDING" VS. RANDOM 
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T-TESTS 

SCORES 
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StuRsJ 


42 


Studonts fool froo to InHlats commu- 
nication with tha principal. 


7.395 


7.155 


.0731 


Teh Rsl 




35 Tha principal la accasslbla 
whan naadod. 


7.763 


7373 


.0523 


TchRal 


35 


Tho principal takaa tjma to llstsn to 
taachars. 


7375 


7345 


3572 


TchRal 


37 


Taachars faal fraa to ahara Idaas and 
concerns about achool w/prlnclpal. 


7ATT 


#.S59 


.056; 






STUDENT RELATIONS FACTOR 



NOTE: Analyst of vaftwx* prov««J Mm* roeuS* on * ft«rnt txoapt #47. Using ANOVA #47 p-lsvel was .0627. Al 
hemeJactonVooinatanotlott itvti 

XMstanolnc/eohools: identity US. Depe/titor* of Ed^ 

Random Schools: IdsroMs d by random tamping of U S. tohooli m 1 16746 stratified, b y o/odo Itvels. 
OoU Cosseted 1S674S. 




AUDIT OF PRINCIPAL EFFECTIVENESS 
OUTSTANDING VS. RANDOM 
ITEMS WITH MOST DIFFERENCES FOR MEAN SCORES 

SCORES 



OUTSTD 


RANDOM 


DIFF. 


FACTOR 


# 


ITEM 


7.510 


5.744 


336 


Org Lin 


9 


Tho principal uStaes rosouroos Sow oubSdo tho 
oohool lo esses In tho rtudy, oovotopmant, Inv 
pternentotton end/or ewelJsSon of ffio school. 


7322 


5305 


.717 


Org Un 


11 


lo InoMdusk S agendas in tho oommunity. 


7200 


6.486 


.714 


OrgUn 


10 


Tho principal provides for gathering * Wo * 
feedback from mjviduee a egcncie* in the 

oomroufSly. 


7359 


6373 


.655 


Aft Pro 


64 


PonwrioltnouQNtthan^cvlhoprirttlpolo^ 
school help taschom develop o tonoo of pride 
ond loyally so msrnbors of iho school 


$.059 


7.424 


345 


TchRal 


40 


Through •ffecftva monaoernont of the dey-by* 
day op .aeon of tho ochooi. tho principal •jto- 
motes, among staff, parents and oommunity. o 
feeing of confidence in ite school 


7.655 


7 OSS 


■OOU 


Arn 1 In 

v/rg up 


17 


Tho pri nopal understands and analym tho 
poktcat aapoctt of education and off eceveiy 
Intorsctt w*th various comnrjnittos. e.g. heal, 
state, national andror various subecturos within 
tho local oommunNy. 


7.628 


7.000 


325 


OrgUn 


6 


Tho principal develops plans for Iho cooperation 
and Imrohromont of tho oommunty, Indvtduais 
and agendas vrift tho achoc*. 


8.062 


7.443 


319 


OrgDIr 


5 


Tho principal * *tek>nc future goals and oVoc- 
Sons tor tho school. 


7J81 


7.272 


.609 


Org Lto 


15 


Tho principal strives to soMsvs autonomy It'tho 
school. 


7.655 


7.107 


391 


OrgDIr 


1 


Tho principal assists ths laouSy m developing 
undofstanaing of. ond support for. boosts 6 
sttfejoetwf^fcm^et>eatsd me educa- 
tional value systsm of tho school 


8.360 


7332 


348 


OrgDIr 


3 


Tho principal has high, professional o«pecU> 
Itont 6 standards lor sotf . teouSy 6 ochooL 



XMtmn0nt'$dmM MMeMtyUS 0— n m « « Ea« o H« t a rn*** hoamm' oSjr e> ISSS 
********* tOMi«**rwtfMi«*an|«fUS v*m* to 1SS*0S. miU fey freft I** 
0t» 0*0*10)7* 




APE 

FACTOR SCORES BY GRADE LEVEL 
"OUTSTANDING SCHOOLS" 



ORGANIZATIONAL DEVELOPMENT 
ORGANIZATIONAL DIRECTION 
ORGANIZATIONAL UNEAOB 
ORGANIZATIONAL PROCEDURE* 



ORGANIZATIONAL ENVIRONMENT 
TEACNBR RELATION* 
STUDENT RELATIONS 
INTERACTIVE PROCESSES 
ATPEOTIVB PROCESSES 



EDUCATIONAL PROGRAM 
INSTRUCTIONAL IMPROVEMENT 
CURRICULUM DEPR< 



8.1 A 
8.0 AB 

7.7 



•r.7 
\7 
8.0- 
7.8 



7.0 
7.8 



JH/MS 
N»43 



7.0 A 
7.7 AB 

7.1 S 



7.3 

7.3 

7.7 AB 

7.1 



7.S 
7.4 



-otrrtTAW— * c tcmoour-. ■ Bmna irm mwi or nwamow Tcoowmow roo- 

CRAM- RIM TO IN*. MTA COLLOCTBO MOT-OB. 



t6 



APE 

FACTOR SCORES 1BV GRADE LEVEL 
1987-88 RANDOM SAMPLE 





BLEIC 
W«43 


JH/MS 
]f«44 


H8 
lf-45 


organizational development 
organizational direction 
organizational linkage 

ORGANIZATIONAL PROCEDURES 


7.8 A 

7.9 ASC 

7.s mc 


7.3 AS 
7.1 ASC 
S.S CD 


7.3A 
7.3A 
S.S BCD 


ORGANIZATIONAL ENVIRONMENT 
TEACHER RELYTIONS 
STUDENT RELATIONS 
INTERACT IVE PROCESSES 
AFFECTIVE PROCESSES 


7.4 AS 
* S AS 

7.5 A 

7.1 C 


7.1 ASC 
7.0 SC 
7.3 A 
S.S D 


7.1 AS 
7.3 A 
7.3 A 
S.7 D 


EDUCATIONAL PROGRAM 

INSTRUCTIONAL BfPROVEMSNT 
CURRICULUM eMPROVEMENT 


7.S AS 
7.3 ASC 


7 A ASC 
S.S cs 


7.1 ASC 
S.S CD 



MEAK WITH Tm tAME UTTM AM WOT oMOWnCAJOVT BUfMJLiMl A. 4Lmt 



< MS 



